Papers with multimodal table understanding
CoReTab: Improving Multimodal Table Understanding with Code-driven Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing datasets for multimodal table understanding provide short factual answers without explicit multi-step reasoning supervision. |
| Approach: | They propose a code-driven reasoning framework that produces scalable, interpretable, and automatically verifiable annotations by coupling multi-step reasoning with executable Python code. |
| Outcome: | The proposed model achieves significant gains over baseline models while producing transparent and verifiable reasoning traces. |
Multimodal Table Understanding (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to understanding tables rely on textual inputs and table images are difficult to access in real-world scenarios. |
| Approach: | They propose a multimodal table understanding problem where the model needs to generate correct responses to various table-related requests based on the given table image. |
| Outcome: | The proposed model outperforms open-source MLLMs on 23 benchmarks under held-in and held-out settings. |
Can GRPO Boost Complex Multimodal Table Understanding? (2025.emnlp-main)
Copied to clipboard
Xiaoqiang Kang, Shengen Wu, Zimu Wang, Yilin Liu, Xiaobo Jin, Kaizhu Huang, Wei Wang, Yutao Yue, Xiaowei Huang, Qiufeng Wang
| Challenge: | Existing table understanding methods struggle with low initialization accuracy and coarse rewards in tabular contexts. |
| Approach: | They propose a three-stage RL framework that enhances multimodal table understanding through: (1) Warm-up that prompts initial perception and reasoning capabilities; (2) Perception Alignment GRPO (PA-GRPO); (3) Hint-Completion GR PO (HC-GRP); |
| Outcome: | The proposed framework outperforms existing models on held-in and held-out datasets, outperforming SFT and GRPO largely. |